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Abstract 


Btrsonsllty  ratings  by  military  psychologists  and  psychiatrists 
who  independently  examined  Itavy  and  civilian  volunteers  for  the  U.S. 
Antarctic  Research  Ihrogram  were  factor  analyzed  by  professional 
group  and  ty  individual.  Factor  patterns  and  trait  meanings  gener¬ 
ally  were  found  to  be  consistent  among  psychologists  using  a  person¬ 
ality  rating  schedule  which  contained  common  trait  adjectives  and 
somewhat  less  consistent  on  another  schedule  which  included  special¬ 
ised  Rorachach  terminology.  Psychologists  and  psychiatrists  as 
groups  were  very  closely  aatched  on  two  of  three  factors;  the  only 
notaUe  difference  between  professional  groups  in  interpretation  of 
the  traits  ir  iUaed  was  on  the  Assertive  item.  Results  were  con¬ 
sidered  encouraging  for  thoee  concerned  with  construction,  standard- 
isationi  and  definition  of  personality  concepts,  but  'further  study 
.is  needed  of  the  correlates  of  Idiosyncratic  frames  of  reference. 


It  is  a  coananplace  observation  that  clinicians  differ  in  their  Inqpressicms  of  personality 
characteristics  and  (dynamics.  Clinicians  with  heterogeneous  educational  and  experiential  back¬ 
grounds  might  be  expected  to  vary  more  widely  in  ascribed  meanings  and  usage  of  psychological 
cmcepts  than  those  with  more  homogeneous  backgrounds.  Militazy  psychologists  and  psychiatrists, 
though  coming  from  diverse  training  institutions  and  social  backgrounds,  arc  exposed  to  similar 
professional  problams,  axparianoaa,  and  patlant  populations  during  thair  caraars.  In  military 
clinical  practios  oartain  ganaral  principlat  and  evaluutiva  framas  of  rtfarcnca  probably  dsvalop 
as  a  reapoosa  to  particular  fSaturas  of  tHi  milltaxy  culture.  In  any  caaa,  within  a  population 
of  milltaxy  psychologlata  and  psychlatriata  it  should  be  possible  to  delineate  the  normative  cr 
preferred  frame  of  reference  for  irvaluating  personality  and  to  determine  variability  among 
individual  cllnicisns  in  relation  to  the  general  norm.  It  would  be  of  theoretical  and  practical 
interest  to  identify  Idlosynoratlc  frames  of  reference,  study  correlated  characteristics  of  . 
clinicians,  and  determine  consaqnanoss  for  reliability  and  validity  of  clinical  judgments. 

The  prsssnt  study  is  concsmsd  with  the  degree  of  variability  that  exists  among  clinicians 
in  their  evaluative  framas  of  refersncs.  To  what  extent  will  a  group  of  experienced  cllnicisns 
agree  in  interpreting  and  using  s  sst  of  personality  and  adjustment  ratings?  A  suitable  method 
for  exploring  this  question  would  bs  to  have  samples  of  clinical  psychologists  and  psychiatrists 
evaluate  sufficient  nuriMrs  of  persons  on  a  coenon  rating  schedule  and  to  factor  analyze  the 
ratings  of  each  of  ths  clinicians  separately  in  order  to  determine  the  underlying  evaluative 
structure  for  that  individual.  The  reeulting  factor  patterns  could  be  compared  and  similarities 
and  differences  among  tfasm  dstsrmlnsd.  This  paper  describes  an  effort  to  carry  out  such  a  study 
of  indlvldxisl  clinicians'  svsluativs  structures. 
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Ms^hods 


Sub.lects-  The  subjects  for  the  stu^y  were  18  clinical  psychologists  and  the  nine  psychia¬ 
trists  who  served  as  examiners  for  Operation  Deep  Freeze  (J.S.  Antarctic  Research  Program). 
Psychologists  ranged  in  clinical  experience  from  three  to  27  years  and  psychiatrists  from  one  to 
21  yea^s.  All  examiners  had  had  previous  clinical  experience  with  Navy  personnel  in  hospital, 
dispensaries,  or  recruit  training  centers;  most  of  the  examiners  had  had  little  or  no  previous 
knowledge  of  Operation  Deep  Freeze  or  of  the  volunteer  population.  About  90  percent  of  the  can¬ 
didates  assessed  were  Navy  personnel  who  ranged  in  age  from  17  to  3»  years  and  represented  a  wide 
variety  of  military  specialties;  the  remainder  of  the  applicants  were  civilian  technicians  or 
scientists  who  were  evaluated  in  the  same  manner  as  the  Navy  personnel.  Detailed  descriptions 
of  the  personal  and  social  characteristics  of  Antarctic  volunteers  have  been  presented  elsewhere 
(Gunderson,  in  press). 

Procedures.  Each  of  the  candidates  was  examined  and  rated  independently  on  a  series  of 
personality  traits  and  adjustment  predictions  by  a  psychologist  and  a  psychiatrist.  Two  different 
rating  schedules  were  en^>l<^ed  over  the  time  period  covered  by  the  study;  the  two  sets  of  person¬ 
ality  ratings  were  analyzed  separately,  hating  variables  in  both  schedules  were  judged  by 
clinicians  to  be  relevant  to  adjustment  in  small  isolated  Antarctic  groups.  Candidates  were 
randomly  assigned  to  examiners  and  generally  a  single  examiner  evaluated  from  15  to  40  candidates 
during  a  single  year.  Data  from  applicants  rated  by  the  same  examiner  were  accumulated  over  two 
or  three  years  for  inclusion  in  the  present  study. 

On  the  first  rating  schedule,  psychologists  rated  24  variables  on  4-  and  S-point  scales. 

Items  were  adjectives  or  sentences  descriptive  of  personality  traits  and  dynamics;  the  source 
of  clinical  impressions  was  a  Rorschach  examination.  pQ^chiatrists  rated  similar  items  on  the 
first  rating  schedule,  deriving  their  impressions  from  a  semi-structured  clinical  interview. 

The  second  rating  schedule  consisted  of  19  variables  which  were  identical  for  psychologists 
and  p^chlatrlsts.  Ratings  were  made  on  6-polnt  scales;  again  items  consisted  of  cooiaon  adjec¬ 
tives  or  brief  sentences  descriptive  of  personality  traits.  For  the  most  part  these  items 
differed  frcai  those  in  the  first  schedule,  although  seven  items  in  the  two  rating  schedules  were 
essentially  the  same  concepts,  a  circumstance  which  helped  identify  similar  factor  content. 
Assessment  forms  which  included  the  trait  ratings  generally  were  filled  out  imnediately  after 
completion  of  the  Rorschach  or  clinical  interview.  Assessments  were  performed  either  at  special 
screening  centers  or  in  Navy  hospitals;  the  same  procedures  were  followed  in  both  settings. 
Instructions  to  examiners  concerning  assessment  procedures  were  general  in  nature,  and  no  precise 
definitions  of  trait  scales  nor  detailed  explanation  of  their  use  was  provided. 
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r.  ifilit  psycho  toglsts  and  three  psychiatrists  were  studleu  in  the  first  series  ot  t  act  or 
analyses;  ten  psychologists  and  six  psychiatrists  were  included  in  the  second  series.  Ratings 
were  intercorrelated  and  factor  analyzed  by  the  principal  axes  method  for  each  of  the  27 
clinicians  separately.  The  analysis  extracted  a  maximum  of  10  factors,  and  rotation  of  factors 
was  accomp'Jished  within  the  same  computer  program.  The  normal  varimax  method  (Kaiser,  1958)  was 
used  for  an  orthogonal  rotational  solution  since  this  method  gives  loadings  that  are  less  vfriart 
over  a  series  of  analyses,  permitting  greater  generalization  of  results.  Various  objective 
methods  have  been  proposed  for  matching  factors  from  one  sample  to  another  (Harman,  1960),  anc  a 
combination  of  visual  inspection  and  statistical  indices  were  employed  in  the  present  study  to 
determine  similarities  and  differences  among  clinicians’  evaluative  structures. 

Results 

A  suranary  of  the  major  results  for  psychologists  on  the  first  rating  schedule  are  shown  in 
Table  1.  Results  for  the  three  psychiatrists  in  the  first  series  are  omitted  from  detailed  con¬ 
sideration  since  the  psychiatrists'  rating  schedule  differed  in  important  respects  from  that 
utilized  by  psychologists.  For  simplicity  and  convenience  of  interpretation,  only  the  highest 
loadings  for  each  individual  psychologist  on  his  first  three  factors  are  Indicated.  Arabic 
numerals  are  used  to  Identify  the  order  or  relative  magnitude  of  the  individual  p^rchologists ' 
factors;  for  example,  the  numeral  (1)  opposite  the  Overall  Effectiveness  item  in  column  A 
indicates  that  Psychologist  A  had  a  loading  of  more  than  .40  for  that  item  on  his  first  (largest) 
factor;  the  numeral  (2)  opposite  Assertive-ItesEive  in  the  same  column  Indicates  a  loading  above 
.40  for  that  item  on  Psychologist  A's  second  factor,  and  so  on.  Traits  included  in  the  Table 
are  those  which  loaded  most  highly  on  the  first  three  factors  (I,  II,  and  II-)  emerging  from  a 
factor  analysis  of  the  pooled  ratings  of  all  eight  psychologists;  each  factor  i.s  represented  by 
three  items  which  form  a  unified  trait  cluster  or  concept.  Reading  down  columns  one  can  discern 
the  unique  factor  sirnictiures  of  the  eight  individual  psychologists  (designated  A  to  H)  and  the 
relationship  of  each  evaluative  structure  to  the  overall  pattern;  reading  across  revs  one  can  see 
the  agreement  in  clustering  of  traits  and  the  relative  importance  (magnitude)  of  the  factors  for 
the  various  clinicians. 

The  largest  factor  emerging  from  pooled  ratings  in  the  first  personality  rating  schedule 
was  best  defined  by  the  three  most  global  items  in  the  rating  schedule,  Oveiall  Effectiveness, 

computer  program  used  to  obtain  the  solution  was  prepared  by  the  staff  of  the  Division 
of  Bio- Statistics,  School  of  Medicine,  University  of  California,  Los  Angeles,  and  computer 
analyses  were  acccxnplished  by  the  Statistical  Department,  U.S.  .*favy  Personnel  Research  Laboratory, 
San  Diego,  wilifomia. 
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Table  1 


Variability  In  Bsychologlats '  Pactor  Structures:  First  Personality  Rating  Schedule 


Psvchologist 

Items 

A 

3 

C 

p 

E 

F 

G 

H 

Factor  I  (All  Combined) 

Overall  Effectiveness 

1« 

1 

3 

2 

3 

2 

2 

ftrefer  to  Work  With 

1 

1 

] 

2 

2 

2 

3 

2 

Likable 

1 

1 

2 

2 

2 

2 

Factor  II  (All  Confined) 

Assertive-l^ssive 

2 

2 

3 

3 

3 

1 

1 

1 

Self-reli.ant-Dependent 

2 

2 

3 

o 

O 

3 

1 

1 

1 

Modest-Boastful 

1 

1 

3 

1 

1 

Factor  Ill  (All  Combined) 

SfouaT  Conflict 

3 

3 

2 

1 

1 

2 

2 

Sexual  Confiislon 

3 

2 

Castration  Anxiety 

2 

1 

1 

N 

9  _  _  _  _ 

40 

71 

88 

1S3 

92 

54 

58 

60 

^Represents  a  loading  of  more  than  .40  on  the  largest  factor  for  the  individual  psychologist, 


2  represents  a  loading  of  more  than  .40  on  the  second  largest  factor,  etc. 

Likable,  and  Prefer  to  Work  With,  li-ase  items  together  indicate  a  generally  favorable  personal 
impression  on  the  part  of  the  clinician,  and  the  factor  has  a  strongly  evaluative  connotation. 
This  factor  was  represented  by  at  least  two  of  the  three  items  in  seven  of  the  eight  individual 
analyses;  only  Psychologist  G  failed  to  utilize  this  cluster.  Factor  I  was  not  consistently  the 
most  important  one  am«jg  individual  psychologists,  however,  in  terms  of  total  variance  accounted 
for,  since  another  cluster  items  absorbed  a  larger  proportion  of  the  variance  for  five  of  the 
eight  clinicians. 

The  second  factor  from  pooled  ratings  appeared  clearly  defined  by  the  items,  Assertive- 
I^sslve  and  Self-reliant-Dependent,  and  to  a  lesser  extent  by  Modest-Boastful.  Agreeme.nt  was 
very  high  among  piQ^chologists  cwicemlng  the  salience  of  this  factor  since  the  Assertive  and 
Self-reliant  traits  form  a  distinctive  pair  for  all  eight  psychologists. 

The  third  fector  from  pooled  ratings  was  concerned  with  sexual  disturbances.  It  emerged 
as  a  distinctive  and  important  factor  for  four  psychologists,  as  indicated  by  substantial 
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loadings  on  at  least  tvo  of  the  three  items,  and  for  two  of  them,  D  and  E,  it  was  the  most 
important  factor. 

Two  other  factors,  although  faiily  well-defined  in  the  overall  factor  analysis,  were  not 
consistent  over  individual  factor  analyses,  and  they  are  omitted  from  discussion  of  the  I'esults. 
These  factors  were  composed  of  the  following  traits:  Absorbs  Stress,  Emotional  Responsiveness, 
and  Adaptable-Rigid;  Aggression,  Interpersonal  Friction,  and  Hostile-Friendly.  Traits  which 
did  not  have  high  loadings  on  any  factor  in  the  overall  factor  analysis  nor  consistently  in 
the  individual  factor  analyse^  were:  Anxiety,  Interpersonal  Conflict,  Depression,  Withdrawn- 
Sociable,  Emotional  Control,  Tense-Relaxed,  Hostile  Against  Self-Others,  Mast’xrbation  Concern, 
and  Self-derying-Self-indulgent.  These  traits  were  apparently  ambiguous,  inconsistent,  or 
irrelevant  in  meaning  to  these  clinicians. 

Psychologists'  data  from  the  second  personality  rating  schedule  is  presented  in  Table  2. 

The  first  factor  was  clearly  defined  by  six  rating  scales,  and  almost  complete  agreement  was 
shown  in  utilizing  these  six  items  as  a  general  evaluative  factor.  At  least  five  of  the  six 
items  have  high  loadings  on  Factor  I'  for  all  ten  psychologists. 

The  second  factor  for  all  psychologists  combined  had  high  loadings  on  six  traits,  and 
the  third  ftictor  was  defined  by  three  scales.  With  minor  variations  in  item  content, 

Factors  II'  and  III'  were  present  in  the  expected  order  for  four  of  the  psychologists  (A,  B, 

C,  and  D)  and  present  but  in  reversed  order  for  tvo  of  the  psychologists  (E  and  F).  Factor 
II'  did  not  emerge  as  a  distinct  factor  for  one  psychologist  (H)  and  Factor  III'  failed  to 
emerge  for  three  psychologists  (G,  I,  and  J).  For  all  three  of  the  latter  individuals,  items 
composing  Factor  III  loaded  highly  on  Factor  I'. 

Three  traits  from  the  second  rating  schedule.  Conforming,  Tactful,  and  Excitable,  were 
not  identified  with  any  single  factor;  one  trait,  I^ranoid,  loaded  substantially  on  Factor 
I'  for  all  psychologists  combined  but  did  not  consistently  load  on  this  factor  for  individual 
clinicians . 

Factor  analyses  for  the  six  psychiatrists'  personality  ratings  are  shown  in  Table  3. 
Essentially  the  same  three  factors  emerged  from  factor  analyses  of  the  psychiatrists'  pco^ed 
ratings  that  had  been  obtained  from  the  psychologists'  ratings.  The  first  factor  had  the 
highest  loadings  on  the  same  six  items  that  defined  the  psycliol -ogists '  general  evaluative 
factor.  The  psychiatrists'  second  factor  contained  the  same  items  that  defined  the  psycholo¬ 
gists'  third  factor,  namely,  Alert,  Orderly,  and  Persevering.  In  addition,  the  Assertive 


Table  2 


iteni  loaded  highly  on  thia  factor  for  psychiatrists.  The  p^chiatrists '  third  factor  included 
four  of  the  same  Itene  that  defined  the  p^chologists '  second  factor  and  two  additional  items, 
Confonaing  and  Tactful.  The  iteM  Hostile  dgainat  Self,  Raranoid,  and  Excitable  did  not  load 
consistently  on  a  single  factor,  although  Paranoid  again  loaded  8ubstanti2dly  on  the  general 
evaluative  factor  for  all  p^chlatrists  coobined. 
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Table  3 


Variability  in  Psychiatrists'  Factor  Structures:  Second  Personality  Rating  Schedule 


Items 

K 

L 

Psychiatrist 

M  N 

0 

P 

** 

Factor  I"  (Ail  Combined) 

Overall  Effectiveness 

1« 

2 

2 

1 

1 

1 

Accepted  by  Peers 

1 

1 

2 

1 

1 

1 

Accepted  by  Leaders 

1 

2 

1 

1 

1 

1 

Prefer  to  Work  With 

1 

2 

2 

1 

1 

1 

Emotional  Control 

1 

2 

2 

1 

2 

1 

Flexibility 

1 

2 

1 

1 

1 

1 

Factor  II"  (All  Combined) 

Assertive 

2 

1 

1 

1 

2 

Alert 

3 

1 

1 

1 

1 

Orderly 

3 

2 

1 

2 

1 

3 

Persevering 

3 

1 

1 

1 

1 

Factor  III"  (All  Combined) 

Aggressive 

Hostile 

Modest 

Acts  Out 

Conforming 

Tactful 


2 

2 

2 

2 

2 

53 


3 

3 

3 


3 

70 


3 

3 

3 

3 

3 

3 

43 


3 

3 

2 

1 

2 

2 

88 


2 

1 

55 


2 

1 

2 

2 

1 

40 


“Represents  a  loading  of  more  than  .40  on  the  largest  factor  for  the  individual  psychiatrist, 
2  represents  a  loading  of  more  than  .40  on  the  second  largest  ftctor,  etc- 


Discussion 

Trait  meanings  for  the  general  evaluative  items  and  the  Assertive-Passive  and  Self-reliant- 
Dependent  pair  of  items  were  generally  consistent  among  psychologists  using  the  first  rating 
schedule  which  was  based  solely  upon  Rorschach  examinations.  The  sex  disturbance  factor  was 
well-defined  in  the  factor  analysis  for  all  raters  combined;  however,  in  the  individual  facto.- 
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analyses  items  coa^sing  this  factor  tended  to  have  weak  loadings  or  loaded  on  another  factor. 
Tuio  trait  cluster  was  the  least  well-defined  and  consistent  over  individual  clinicians  of 
those  isolated  in  the  stw^. 

High  agreement  was  shown  among  the  10  psychologists  In  interpreting  the  personality  traits 
utilized  in  the  second  rating  schedule.  Three  factors  emerged  which  were  represented  in  the 
fisctor  patterns  of  the  majority  of  individual  psychologists.  Four  psychologists  employed  a 
soaHwhat  diff^nt  intarpratlvs  acheme  from  this  majcarlty,  utilizing  only  two  of  the  three 
cosaion  factora.  fhccor  I's  the  general  evaluative  ftctor,  was  very  stable  and  uniform  over 
individual  clinicians;  Factor  II'  varied  sor.-what  in  item  loading  patterns  among  individuals, 
but  three  or  more  items  were  represented  in  nine  of  the  10  individual  analyses;  Factor  III’ 
was  least  consistent,  although  at  least  two  of  the  three  items  were  present  in  seven  of  the 
individual  patterns. 

Factor  patterns  for  the  pqrchlatriete  were  somewhat  more  variable  than  those  for  the 
psychologists  on  both  rating  schedules.  On  the  second  rating  schedule  the  identical  general 
evaluative  factor  was  present  for  all  p^chletrlata  that  was  present  for  all  psychologists. 

The  pq^chiatrlata '  second  factor  was  clearly  defined  for  only  three  individual  p^chiatrists; 
for  ft^ychlatrlste  0  and  P  Factor  11"  merged  with  Factor  I".  For  Paychlatriet  N  this  factor 
does  not  appear  in  Table  3  but  was  not  entirely  lost  since  the  Assertive  and  Alert  pair  of 
items  emerged  as  the  fourth  factor  for  this  individual.  The  third  ftictor  was  apparent  in  all 
six  individual  factor  analyses,  although  the  Aggressive  and  Hostile  item  pair  split  off  as  a 
separate  factor  for  two  Individuals  (N  and  0).  The  on’y  major  differences  between  overall 
patterns  for  p^chlatrlsts  and  psychologists  was  the  appearance  of  the  Assertive  item  in 
different  constellations  of  traits.  This  trait,  which  had  a  definitely  negative  connotation 
for  psychologists  being  highly  related  to  Aggressive,  Acts  Out,  Hostile,  etc.,  had  a  more 
positive  in^jllcation  in  the  psychiatrists'  lexicon,  being  part  of  the  Alert,  Orderly,  and 
Bersevering  trait  cluster. 

A  close  slailarity  is  noted  between  the  p^chologists’  Factor  II  and  Factor  II’  of  the 
present  study  Cattell's  Oomlnance-Submissiveness  Factor  (E)  composed  of  the  following  traits 
Self-Assertive,  Confident  vs.  Submissive,  Unsure;  Boastful,  Conceited  vs.  Modest-Retiring: 
Aggressive,  Pugnacious  vs.  Complaisant;  Exrrapunitive  vs.  Impunitive,  Intropunitive;  etc., 
(Cattell,  1957,  p.  108).  Also,  there  is  an  obvious  similarity  between  Cattell's  Super  Ego 
Strength  Factor  (G),  which  Includes  the  traits.  Persevering,  Determined  vs.  Quitting,  Fickle, 
and  Insistently  Ordered  vs.  Relaxed,  Indolent  (Cattell,  1957,  p.  122),  and  the  psychologists ’ 
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Factor  III'  in  the  second  rating  schedule.  While  such  comparisons  of  factor  results  frocn  data 
gathered  under  very  different  conditions  can  only  be  suggestive*  they  tend  to  further  confidence 
in  the  generality  of  the  trait  concepts  involved. 

Agreement  between  psychologists  and  psychiatrists  as  groups  with  respect  to  trait  meanings 
obviously  quite  good  as  shown  by  the  similarity  in  content  of  item  clusters  listed  in 
Tables  2  and  3.  Agreement  also  was  found  to  be  high  using  an  objective  matching  procedure 
described  Hannan  (1960,  p.  257).  This  index  of  factor  slmiJirity,  called  by  Harman  the 
coefficient  of  congruence,  is  analogous  to,  but  is  not,  a  correlation  coefficient.  The 
coefficient  between  first  factors  (Factor  I'  and  Factor  I")  for  psychologists  combined  and 
psychiatrists  combined  was  .90;  for  psychologists'  Factor  II'  versus  psychiatrists'  Factor 
III",  the  coefficient  was  .77;  for  pQfchologists ’  Factor  III'  versus  psychiatrists'  Factor 
II",  the  index  was  .96.  It  is  inferred  that  two  of  the  factors  were  very  closely  matched 
between  clinician  groups  and  that  substantial  agreement  was  present  for  the  third  factor. 

The  prominence  of  the  Assertive  trait  in  the  psychologists'  Factor  II'  and  the  absence  of 
this  trait  in  the  corresponding  psychiatrists'  Factor  III"  could  very  well  account  for  the 
lower  agreement  on  that  ftictor. 

Differences  in  factor  structures  of  the  two  rating  schedules  can  be  attributed,  in  part, 
to  the  varying  nunbers  of  items  included  and  to  the  specialized  terminology  associated  with 
the  interpretation  of  the  Rorschach.  A  deliberate  effort  was  made  in  constructing  the  second 
rating  schedule  to  use  only  common  traits  or  adjective  descriptions  since  low  inter-rater 
reliabiJLitles  had  been  observed  in  the  earlier  schedule,  and  apparently  a  greater  degree 
of  agreement  in  meanings  of  trait  concepts  was  achieved.  The  nvtnber  of  factors  obtained 
from  these  rating  data  was  probably  limited  by  the  small  sampling  of  traits  included  in  the 
rating  schedules  and  by  the  fact  that  the  trait  ratings  tended  to  be  rather  highly  inter- 
correlated.  However,  the  repeated  emergence  of  just  three  major  factors  in  the  present  study 
tends  to  correspond  closely  with  the  number  found  consistently  by  Osgood  in  his  work  with  the 
"semantic  differential."  With  this  technique  factor  analyses  of  adjectival  scales  consistently 
reduced  to  three  main  dimensions,  usually  labelled  Evaluative  (large  general  factor).  Potency, 
and  Activity.  While  most  of  Osgood's  studies  pro%’ided  only  average  attitudes  of  many  judges, 
he  has  summarized  the  work  of  one  of  his  students  who  apjlied  the  method  to  the  analysis  of 
individual  semantic  frameworks  (Osgood,  1062).  Oscood's  technique  differed  in  an  important 
way  from  the  methods  of  the  present  study  in  that  his  judges  rated  abstract  concepts  rather 
tlan  real  persons  in  an  actual  clinical  setting.  Cronbach  s  (1958)  suggestions  for  majning 


the  individual’s  ’’implicit  perscfiality  theory”  are  believed  to  offer  a  partiiularly  fruitful 
approach  for  analyses  of  clinicians'  perswiallty  concepts. 

While  there  rfere  striking  similarities  in  trait  meaning  patterns  among  the  majority  of 
clinicians  studied,  It  is  noted  that  Psychologists  B,  F,  G,  and  H  differed  from  the  other 
pi^chclogists  In  tl»e  first  series  In  omitting  sex  disturbances  as  an  important  factor. 
P^chologists  G',  H',  I',  and  J'  and  Psychiatrists  N,  0,  and  P  in  the  second  series  similarly 
deviated  notably  from  the  modal  pattern  through  merging  or  splitting  of  factors.  It  might  be 
speculated  tiiat  the  absence  of  shared  trait  meanings  could  affect  inter-judge  reliability; 
for  example,  Psychiatrist  P’s  judgsuents  might  not  be  in  agreement  with  nor  intelligible  to 
Ptychologlst  F*.  In  fact,  In  a  series  of  applicants  rated  independently  by  these  tvo  clinicians, 
an  average  Pearaon  reliability  coefficient  of  -.03  over  all  traits  in  the  first  factor  was 
obtained.  On  the  other  hand.  Psychologist  F*  agreed  somewhat  better  with  Psychiatrist  M,  whose 
factor  pattern  closely  resenhled  Ills  own,  attaining  an  average  reliability  coefficient  of  .49 
over  all  traits  in  the  first  factor.  While  this  example-  is  merely  illustrative,  it  points  out 
a  possible  consequence  of  idiosyncratic  frames  of  reference  wortty  of  further  investigation, 
namely,  the  reduction  cf  inter-judge  reliability.  Another  worthwhile  extension  of  the  present 
research  might  be  to  determine  the  relationships  of  various  characteristics  cf  Individual 
clinicians,  such  as  amount  and  type  of  clinical  experience,  to  deviant  or  unique  rating  patterns. 
A  practical  outcome  of  the  study  la  the  demonstrated  feasibility  of  combining  single  traits  into 
stable  clusters  which  have  similar  meanings  for  the  majority  of  clinicians  working  in  this 
special  setting.  Results  might  be  expected  to  differ  in  other  settings,  such  as  hospitals  or 
out-patient  clinics,  and  In  other  populations.  It  seems  evident  that  factor  analyses  of 
individual  evaluative  Irameworks  may  contribute  significantly  to  -an  understanding  of  sources 
of  variance  in  clinical  Judgments. 
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